Augmented reality view of product instructions

ABSTRACT

In a system for presenting augmented reality views of product instructions a method may include receiving a request from a client device, the request including image data. The method may further includes identifying an object in the image data and generating an augmented reality view of the identified object. The method may further include transmitting the augmented reality view to the client device.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/990,291, filed Jan. 7, 2016, entitled “AUGMENTED REALITY VIEW OFPRODUCT INSTRUCTIONS,” (and issued as U.S. Pat. No. 9,953,350 on Apr.24, 2018), which claims the benefit of priority to U.S. application Ser.No. 13/624,682, filed on Sep. 21, 2012, entitled “AUGMENTED REALITYPRODUCT INSTRUCTIONS, TUTORIALS AND VISUALIZATIONS,” (and issued as U.S.Pat. No. 9,336,541 on May 10, 2016), which is hereby incorporated byreference.

TECHNICAL FIELD

Example embodiments of the present application generally relate to imagerecognition, and more particularly, to a system and method for enhancedproduct instructions, tutorials, and visualizations using augmentedreality.

BACKGROUND

Today's products are increasingly complex to set up and operate. Often,the products are accompanied with detailed instructions that may bedaunting for a user to follow. In other cases, a user may discardinstructions after an initial set up of a product. In yet other cases,it may be difficult to determine what product accessories are requiredfor a product. In each of these cases, the user's ability to operate theproduct may be hampered by a lack of information about the product or aninability to use the product. This in turn may affect the user'sexperience with the product and the user's perception of themanufacturer of the product.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawings, which are not necessarily drawn to scale, like numeralsdescribe substantially similar components throughout the several views.The drawings illustrate generally, by way of example, but not by way oflimitation, various embodiments discussed in the present document.

FIG. 1 is a network diagram depicting a network system, according tosome embodiments, having a client-server architecture configured forexchanging data over a network.

FIG. 2 is a block diagram illustrating multiple publicationapplications, which may be provided as part of a network-basedpublication system, according to some example embodiments.

FIG. 3 is a diagram illustrating the generation of an augmented realityview of an item, according to some embodiments.

FIG. 4 is a flow chart of an example method for generating an augmentedreality of view of an item, according to some embodiments.

FIG. 5 is a flow chart of an example method for processing inputsreceived from an augmented reality-enhanced display of an item,according to some embodiments.

FIG. 6 shows a diagrammatic representation of machine in the exampleform of a computer system within which a set of instructions may beexecuted to cause the machine to perform any one or more of themethodologies discussed herein.

DETAILED DESCRIPTION

Although the present invention has been described with reference tospecific example embodiments, it will be evident that variousmodifications and changes may be made to these embodiments withoutdeparting from the broader spirit and scope of the invention.Accordingly, the specification and drawings are to be regarded in anillustrative rather than a restrictive sense.

In various embodiments, a system and method to provide instructions,visualizations, and recommendations based on an augmented reality viewof an item are disclosed.

FIG. 1 is a network diagram depicting a network system 100, according toone embodiment, having a client-server architecture configured forexchanging data over a network. For example, the network system 100 maybe a publication/publisher system 102 where clients may communicate andexchange data within the network system 100. The data may pertain tovarious functions (e.g., online item purchases) and aspects (e.g.,managing content) associated with the network system 100 and its users.Although illustrated herein as a client-server architecture as anexample, other embodiments may include other network architectures, suchas a peer-to-peer or distributed network environment.

A data exchange platform, in an example form of a network-basedpublisher 102, may provide server-side functionality, via a network 104(e.g., the Internet), to one or more client devices. The one or moreclient devices may be operated by users that use the network system 100and more specifically, the network-based publisher 102, to exchange dataover the network 104. These transactions may include transmitting,receiving (communicating) and processing data to, from, and regardingcontent and users of the network system 100. The data may include, butare not limited to, content and user data such as image data; productand service reviews; product, service, manufacture, and vendorrecommendations and identifiers; product and service listings associatedwith buyers and sellers; product tutorials and instructions; productvisualization data; auction bids; and transaction data, among otherthings.

In various embodiments, the data exchanges within the network system 100may be dependent upon user-selected functions available through one ormore client or user interfaces (UIs). The UIs may be associated with aclient device, such as a client device 106 using a web client 110. Theweb client 110 may be in communication with the network-based publisher102 via a web server 120. The UIs may also be associated with a clientdevice 108 using a programmatic client 112, such as a clientapplication, or a third party system 114 (e.g., one or more servers orclient devices) hosting a third party application 116. It can beappreciated in various embodiments the client device 106, 108, and/orthe third party system 114 may be associated with a buyer, a seller, athird party electronic commerce platform, a payment service provider, ora shipping service provider, each in communication with thenetwork-based publisher 102 and optionally each other. The buyers andsellers may be any one of individuals, merchants, or service providers,among other things.

Turning specifically to the network-based publisher 102, an applicationprogram interface (API) server 118 and a web server 120 are coupled to,and provide programmatic and web interfaces respectively to, one or moreapplication servers 122. The application servers 122 host one or morepublication application(s) 124. The application servers 122 are, inturn, shown to be coupled to one or more database server(s) 126 thatfacilitate access to one or more database(s) 128.

In one embodiment, the web server 120 and the API server 118 communicateand receive data pertaining to listings, transactions, and feedback,among other things, via various user input tools. For example, the webserver 120 may send and receive data to and from a toolbar or webpage ona browser application (e.g., web client 110) operating on a clientmachine (e.g., client machine 106). The API server 118 may send andreceive data to and from an application (e.g., client application 112 orthird party application 116) running on another client machine (e.g.,client machine 108 or third party server 114).

The publication application(s) 124 may provide a number of publisherfunctions and services (e.g., listing, payment, etc.) to users thataccess the network-based publisher 102. For example, the publicationapplication(s) 124 may provide a number of services and functions tousers for listing goods and/or services for sale, facilitatingtransactions, and reviewing and providing feedback about transactionsand associated users. Additionally, the publication application(s) 124may track and store data and metadata relating to listings,transactions, and user interaction with the network-based publisher 102.The publication application(s) 124 may aggregate the feedback and/or thetracked data and metadata to enable a user to collectively viewaccumulated feedback and/or tracked data. In one example embodiment,from the aggregated data, the publication application(s) 124 maydetermine a reputation, for example, in the form of a score or value,for one or more users of a network-based community, the reputation valuebeing based on one or more user attributes associated with the one ormore users.

FIG. 1 also illustrates a third party application 116 that may executeon a third party system 114 and may have programmatic access to thenetwork-based publisher 102 via the programmatic interface provided bythe API server 118. For example, the third party application 116 may useinformation retrieved from the network-based publisher 102 to supportone or more features or functions on a website hosted by the thirdparty. The third party website may, for example, provide one or morelisting, informational, publisher, or payment functions that aresupported by the relevant applications of the network-based publisher102.

FIG. 2 is a block diagram illustrating an example embodiment of multiplepublication application(s) 124, which are provided as part of thenetwork-based publisher 102. The applications 124 may be hosted ondedicated or shared server machines (not shown) that are communicativelycoupled to enable communications between server machines. Theapplications themselves are communicatively coupled (e.g., viaappropriate interfaces) to each other and to various data sources, so asto allow information to be passed between the applications or so as toallow the applications to share and access common data. The applicationsmay furthermore access application servers 122 and one or more databases128 via database servers 126.

The networked system 102 may provide a number of publishing, listing,and price-setting mechanisms whereby a seller may list (or publishinformation concerning) goods or services for sale, a buyer can expressinterest in or indicate a desire to purchase such goods or services, anda price can be set for a transaction pertaining to the goods orservices. To this end, the publication applications 124 are shown toinclude store application(s) 202 that permit sellers to list individualgoods and/or services (hereinafter generically referred to as “items”)for sale via the network-based publisher or group their listings withina “virtual” store, which may be branded and otherwise personalized byand for the sellers. Individual and grouped listings may include detailssuch as a title of an item offered for sale, a description of the item,a price of the item, one or more pictures of the item, a geographiclocation of the seller or the item, payment and shipping options, and areturn policy. The virtual store also may offer promotions, incentivesand features that are specific and personalized to a relevant seller. Inone embodiment, a seller using a virtual store to sell their goods andservices may result in the network-based publisher 102 determining ahigher reputation value because of an inherent trustworthiness (e.g.,higher reputation value) of a “business” over an individual seller.

Within the store application(s) 202 may be included one or more auctionapplications (not shown) which support auction-format listing and pricesetting mechanisms (e.g., English, Dutch, Vickrey, Chinese, Double,Reverse auctions etc.). The various auction applications may alsoprovide a number of features in support of such auction-format listings,such as a reserve price feature whereby a seller may specify a reserveprice in connection with a listing and a proxy-bidding feature whereby abidder may invoke automated proxy bidding.

The store application(s) 202 may further include a number of fixed-priceapplications (not shown) support fixed-price listing formats (e.g., thetraditional classified advertisement-type listing or a cataloguelisting) and buyout-type listings. Specifically, buyout-type listings(e.g., including the Buy-It-Now (BIN) technology developed by eBay Inc.,of San Jose, Calif.) may be offered in conjunction with auction-formatlistings, and allow a buyer to purchase goods or services, which arealso being offered for sale via an auction, for a fixed-price that istypically higher than the starting price of the auction.

Although the auction and fixed-priced applications have been describedas being part of the store application(s) 202 herein, it is contemplatedthat the auction and fixed-priced applications may be standaloneapplications.

An imaging module 204 receives an image transmitted from a client device(e.g., client device 106). In some embodiments, the imaging module 204performs image recognition techniques (e.g., edge detection, foregroundsegmentation, pattern matching) on the image to identify an object oraspects of the object contained within the image. To the extentnecessary, the imaging module 204 may enhance the attributes of theimage to aid in the processing of the image.

A fingerprinting module 206 may receive the processed image from theimaging module 204 and may generate one or more fingerprints of theimage. In some embodiments, the fingerprints may refer to the object(s)contained within the image rather than the entire image itself. Thefingerprints may be identifiers that identify the object contained inthe image. In some embodiments, the identifier may be a number. In someembodiments, the identifier may be a unique identifier that identifiesthe object, while in other embodiments, the identifier may be a sharedidentifier that, for example, identifies a particular attribute orcategory of the object. In some embodiments, the fingerprints aremarkers in the image that aid the processing of the image. A fingerprintmay be calculated using information within the image. For example, aluminosity histogram may be used as a fingerprint.

The fingerprinting module 206 may generate a database of fingerprintscorresponding to one or more items. In the event the fingerprintingmodule 206 identifies an unknown fingerprint, the fingerprinting module206 may perform procedures to identify and store the fingerprint in thedatabase. Such procedures may include prompting a user to provideadditional information about the unknown object in the image, extractingobject attributes from the image containing the unknown object,accessing one or more external systems to look up and retrieveadditional information related to the object, and so forth. For example,the user may be prompted to identify the object by speaking about theobject. The fingerprinting module 206 may perform voice recognition toconvert the audio information into one or more object attributes.

A computer vision module 208 compares the one or more fingerprints tothe database of stored fingerprints. Using the results of thecomparison, the computer vision module 208 may process the image toidentify any objects contained in the image.

An augmented reality module 210 generates an augmented reality view tooverlay the image received from the client device. In some embodiments,the augmented reality view is positioned over the image using theidentified fingerprints. The augmented reality view may be interactive,and one or more different augmented reality views may be generateddepending on interactions with the augmented reality view by the user.For example, a first augmented reality view may identify the object oraspects of the object contained in the image. In response to user input,in some embodiments, a second augmented reality view corresponding toinstructions or tutorials relating to the object may be presented. Insome embodiments, a third augmented reality view may identify one ormore products offered for sale. The products may be the object itself oritems related to the object. In some embodiments, the augmented realityview may be a video that is overlaid on the object.

A database interface module 212 accesses one or more databases andretrieves data for inclusion in the augmented reality views. The datamay correspond to instructions or tutorials for products, listings ofproducts or related products offered for sale, directions to one or moresellers offering the products or related products for sale, and soforth. In some embodiments, the databases may include databases bothinternal to the network-based publisher 102 and external.

In an embodiment, an augmented reality view may include position datarelating where to position the retrieved data in the image or video. Theposition data may be absolute (e.g., coordinate), relative to an edge ofthe image (e.g., 10 pixels from the top), or relative to an identifiedobject in the image (e.g., in the 5 pixels left of the object).

A recommendations engine 214 receives information identifying theobject(s) contained in the image and generates product recommendationsthat may be included in the augmented reality view. In an embodiment,the product recommendations are retrieved from a database. The productrecommendations included in the augmented reality view may beinteractive. For example, upon selection of a product presented in anaugmented reality view, the user may be redirected into a purchase flowwhereby the user may perform the steps needed to purchase the product.In various embodiments, the steps may include directing the user to anonline marketplace. The online marketplace may include a listing ofpurchase opportunities related to the product recommendation. Forexample, a product recommendation may be for an audio cable when theobject in the image is a stereo. When the audio cable recommendation ispresented on the client device and the audio cable is selected, the usermay be taken to a listing of audio cables available for purchase. Aswith the data in the database, position data for the recommendations maybe defined for use in the augmented reality view.

FIG. 3 illustrates an example client device 106 in the form of a mobiletablet computer. Other client devices may include, but are not limitedto, laptop computers and mobile phones (e.g. smart phones). In variousembodiments, the client device includes at least one processor, display,image capture device, network interface, and input device. The displaymay be a touchscreen or non-interactive display. In an embodiment, theimage capture device is a camera. The network interface may beconfigured to transmit and receive on multiple frequencies (e.g., 4G,3G, 802.11, etc.) over network 104 with publication system 102. Theinput device may be a keyboard, touchscreen, gesture capture, stylus ora combination thereof. In various embodiments, client device 106 alsoincludes one or more applications that are executed by the at leastprocessor. The executed applications may be configured to perform thefunctions and methods described herein.

FIG. 3 further illustrates electronics item 300. In an embodiment,electronics item 300 is a video player. The video player may includevideo RCA output 302, audio RCA outputs 304, 306, VGA output 306, andHDMI output 310. FIG. 3 illustrates client device capturing an image ofelectronics item 300 using an image capture device.

FIG. 4 illustrates an example method to provide an augmented realityview of an item on a client device. In this example, the method 400 mayinclude operations such as receiving image data from the client device402, converting image data into a fingerprint 404, comparing thefingerprint to stored fingerprints 406, generating an augmented realityview of the an item based on the identified fingerprint 408, andproviding the augmented reality view of the item to a client device foroverlay 410.

At block 402, image data is received from a client device. In anembodiment, the image data is received over network 104 at applicationserver such as application server 122. The image data may be from animage captured using an image capture device of the client device. Forexample, an application may be run on the client device that prompts theuser to take a picture of an object (e.g., an item) the user wishesadditional information for. In various embodiments, guidelines arepresented on the display of the client device to help frame a picture ofthe object. After the picture is taken, the resulting image data may betransmitted to the application server. In various embodiments, multipleimages are taken and transmitted to the application server.

In an embodiment, at block 404, the image data is converted into adigital fingerprint (e.g., a numerical value or series of values ofcharacteristics of the image). The conversion process may be done usinga module such as fingerprinting module 206 as described previously. Morethan one fingerprint may be generated from the image data.

In an embodiment, at block 406, the digital fingerprint(s) from block404 is compared against a database of stored digital fingerprints. Forexample the digital fingerprint from image data may be a number that wasgenerated using fingerprint module 206. A database of stored digitalfingerprints may be queried using the generated number for possiblematches.

In an embodiment, at block 408, an augmented reality view of the itembased on the identified fingerprints is generated and, at block 410, theaugmented reality view of the item may be transmitted back to the clientdevice for overlay. For example, a module such as augmented realitymodule 210, may be used to retrieve information associated with theelectronics item. This processes is explored in further detail in FIG.5. The gathered information may be transmitted as alphanumeric data,video data, or image data, to the client device as an augmented realityview. For example, the alphanumerical data may include text identifyingcomponents 302-310. This text, or other data, may then be overlaid on apicture of electronics item 300 within the display of client device 106.

In various embodiments, the application server determines the locations(e.g., position) of where to overlay the gathered information in theaugmented reality view. In an embodiment, the information itself andplacement information may be considered a generated augmented realityview. In various other embodiments, the data is overlaid in a video ofelectronics item 300. The video may be a “live” view of the electronicsitem as a user is pointing the image capture device at the item.

FIG. 5 is a flow chart 500 of an example method for processing inputsreceived from an augmented reality-enhanced display of an item at anapplication server, according to some embodiments. The method be startedafter transmitting an augmented reality view as discussed in flow chart400. In this example, the method 500 may include operations suchreceiving input from a client device displaying the augmented realityview of an item 502 and determining the type of input 504 then, if thetype is instructions, retrieving instructions of tutorials for the item506, and presenting the instructions of tutorial for the item on aclient device 508, if the type is an ad, retrieving promotional itemsfor the item 510, and presenting the promotional items for the item on aclient device 512, and if the type is commerce, retrieving itemrecommendations for the item 514, and presenting the itemrecommendations for the item on a client device 516.

In an embodiment, at block 502, input is received from a client devicedisplaying an augmented reality view of an item. In other embodiments,the input may be received with the image data. The input may represent arequest type for additional information concerning the item. Forexample, the input may be for instructional information, promotionalinformation, or commerce information. Additional input types may also beused without departing from the scope of this disclosure. In variousembodiments, an application running on the client device prompts a userfor the request type.

In an embodiment, at decision block 504, it is determined what type ofinput has been requested from the user based on the receivedinformation. As depicted, one of three types of input may be processedwith method 500.

In an embodiment, at block 506, it is determined that the request typeis for instructions related to the item displayed on the client deviceinstructions or tutorials are retrieved for the item. For example, theidentification of the object (e.g., as determined from the fingerprint)may be used as an input to a query of an internal database containinginstructions and tutorials for a plurality of items. In variousembodiments, externals sources are searched for instructions andtutorials related to the item. The retrieved instructions or tutorialsare then transmitted back to the client device. In an embodiment, atblock 508, the client device displays the instructions or tutorials.

In an embodiment, at block 510, it is determined that the request typeis for advertisements related to the item displayed on the client deviceand promotional materials are retrieved for the item. For example, theidentification of the object (e.g., as determined from the fingerprint)may be used as an input to a query of an internal database containingpromotional materials for a plurality of items. In various embodiments,externals sources are searched for promotional materials related to theitem. The retrieved promotional materials are then transmitted back tothe client device. In an embodiment, at block 512, the client devicedisplays the promotional materials. In various embodiments, additionalinformation such as where to purchase items included in the promotionalmaterials may be transmitted to the client device.

In an embodiment, at block 514, it is determined that the request typeis for commerce materials related to the item displayed on the clientdevice and item recommendation are retrieved for the item. For example,the identification of the object (e.g., as determined from thefingerprint) may be used as an input to a query of an internal databasecontaining item recommendations for a plurality of items (e.g., usingrecommendations engine 214). In various embodiments, externals sourcesare searched for item recommendations related to the item. The retrievedrecommendations are then transmitted back to the client device. In anembodiment, at block 512, the client device displays the itemrecommendations. In an embodiment, a location (e.g., website, physicaladdress, e-commerce listing) to purchase the item is also transmitted tothe client device.

FIG. 6 shows a diagrammatic representation of machine in the exampleform of a computer system 600 within which a set of instructions may beexecuted causing the machine to perform any one or more of themethodologies discussed herein. In alternative embodiments, the machineoperates as a standalone device or may be connected (e.g., networked) toother machines. In a networked deployment, the machine may operate inthe capacity of a server or a client machine in server-client networkenvironment, or as a peer machine in a peer-to-peer (or distributed)network environment. The machine may be a personal computer (PC), atablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), acellular telephone, a web appliance, a network router, switch or bridge,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. Further,while only a single machine is illustrated, the term “machine” shallalso be taken to include any collection of machines that individually orjointly execute a set (or multiple sets) of instructions to perform anyone or more of the methodologies discussed herein.

The example computer system 600 includes a processor 602 (e.g., acentral processing unit (CPU), a graphics processing unit (GPU) orboth), a main memory 604 and a static memory 606, which communicate witheach other via a bus 608. The computer system 600 may further include avideo display unit 610 (e.g., a liquid crystal display (LCD) or acathode ray tube (CRT)). The computer system 600 also includes analphanumeric input device 612 (e.g., a keyboard), a user interface (UI)navigation device 614 (e.g., a mouse), a disk drive unit 616, a signalgeneration device 618 (e.g., a speaker) and a network interface device620.

The disk drive unit 616 includes a machine-readable medium 622 on whichis stored one or more sets of instructions and data structures (e.g.,software 624) embodying or utilized by any one or more of themethodologies or functions described herein. The software 624 may alsoreside, completely or at least partially, within the main memory 604and/or within the processor 602 during execution thereof by the computersystem 600, the main memory 604 and the processor 602 also constitutingmachine-readable media.

The software 624 may further be transmitted or received over a network626 via the network interface device 620 utilizing any one of a numberof well-known transfer protocols (e.g., HTTP).

While the machine-readable medium 622 is shown in an example embodimentto be a single medium, the term “machine-readable medium” should betaken to include a single medium or multiple media (e.g., a centralizedor distributed database, and/or associated caches and servers) thatstore the one or more sets of instructions. The term “machine-readablemedium” shall also be taken to include any medium that is capable ofstoring, encoding or carrying a set of instructions for execution by themachine and that cause the machine to perform any one or more of themethodologies of the present invention, or that is capable of storing,encoding or carrying data structures utilized by or associated with sucha set of instructions. The term “machine-readable medium” shallaccordingly be taken to include, but not be limited to, solid-statememories, optical media, and magnetic media.

The Abstract of the Disclosure is provided to comply with 37 C.F.R. §1.72(b), requiring an abstract that will allow the reader to quicklyascertain the nature of the technical disclosure. It is submitted withthe understanding that it will not be used to interpret or limit thescope or meaning of the claims. In addition, in the foregoing DetailedDescription, it can be seen that various features are grouped togetherin a single embodiment for the purpose of streamlining the disclosure.This method of disclosure is not to be interpreted as reflecting anintention that the claimed embodiments require more features than areexpressly recited in each claim. Rather, as the following claimsreflect, inventive subject matter lies in less than all features of asingle disclosed embodiment. Thus the following claims are herebyincorporated into the Detailed Description, with each claim standing onits own as a separate embodiment.

1. A method comprising: receiving, from an image capturing device of aclient device, image data captured by the image capturing device;identifying, from the received image data, one or more objects;generating an augmented reality view of at least one of the one or moreidentified objects, the augmented reality view including the receivedimage data and information correlated with the identified objectsuperimposed on the received image data; and transmitting the augmentedreality view for display on the client device in real time.
 2. Themethod of claim 1, wherein the generated augmented reality view is alive view of the one or more objects captured in the image data by theimage capturing device.
 3. The method of claim 1, wherein the generatedaugmented reality view provides for user interactivity on a displaydevice on the client device.
 4. The method of claim 3, wherein thegenerated augmented reality view is a first augmented reality view, themethod further comprising: receiving an interactive user input from thedisplay device of the client device; generating, in response toreceiving the interactive user input, a second augmented reality view,the second augmented reality view including the received image data andinformation corresponding to the interactive user input superimposed onthe received image data; and transmitting the second augmented realityview for display on the client device in real time.
 5. The method ofclaim 4, wherein the information corresponding to the interactive userinput in the second augmented reality view includes a tutorial relatedto the at least one of the one or more identified objects.
 6. The methodof claim 4, wherein the information corresponding to the interactiveuser input in the second augmented reality view includes a listing ofthe at least one of the one or more identified objects for sale on amerchant website.
 7. The method of claim 1, wherein the informationcorrelated with the identified object that is superimposed on thereceived image data in the augmented reality view is a video.
 8. Acomputer-readable storage device including instructions stored thereon,which when executed by at least one processor, cause the processor toperform operations comprising: receiving, from an image capturing deviceof a client device, image data captured by the image capturing device;identifying, from the received image data, one or more objects;generating an augmented reality view of at least one of the one or moreidentified objects, the augmented reality view including the receivedimage data and information correlated with the identified objectsuperimposed on the received image data; and transmitting the augmentedreality view for display on the client device in real time.
 9. Thestorage device of claim 8, wherein the generated augmented reality viewis a live view of the one or more objects captured in the image data bythe image capturing device.
 10. The storage device of claim 8, whereinthe generated augmented reality view provides for user interactivity ona display device on the client device.
 11. The storage device of claim10, wherein the generated augmented reality view is a first augmentedreality view, and wherein the operations further comprise: receiving aninteractive user input from the display device of the client device;generating, in response to receiving the interactive user input, asecond augmented reality view, the second augmented reality viewincluding the received image data and information corresponding to theinteractive user input superimposed on the received image data; andtransmitting the second augmented reality view for display on the clientdevice in real time.
 12. The storage device of claim 11, wherein theinformation corresponding to the interactive user input in the secondaugmented reality view includes a tutorial related to the at least oneof the one or more identified objects.
 13. The storage device of claim11, wherein the information corresponding to the interactive user inputin the second augmented reality view includes a listing of the at leastone of the one or more identified objects for sale on a merchantwebsite.
 14. The storage device of claim 8, wherein the informationcorrelated with the identified object that is superimposed on thereceived image data in the augmented reality view is a video.
 15. Asystem comprising: a server comprising: a communication deviceconfigured to receive, from an image capturing device of a clientdevice, image data captured by the image capturing device; one or moreprocessors in communication with the communication device; and one ormore non-transitory computer-readable media storing instructions thereonthat, when executed by the one or more processors, cause the server toperform operations, the operations including: identifying, from thereceived image data, one or more objects; generating an augmentedreality view of at least one of the one or more identified objects, theaugmented reality view including the received image data and informationcorrelated with the identified object superimposed on the received imagedata; and transmitting the augmented reality view for display on theclient device in real time.
 16. The system of claim 15, wherein thegenerated augmented reality view is a live view of the one or moreobjects captured in the image data by the image capturing device. 17.The system of claim 15, wherein the generated augmented reality viewprovides for user interactivity on a display device on the clientdevice.
 18. The system of claim 17, wherein the generated augmentedreality view is a first augmented reality view, and wherein theoperations further comprise: receiving an interactive user input fromthe display device of the client device; generating, in response toreceiving the interactive user input, a second augmented reality view,the second augmented reality view including the received image data andinformation corresponding to the interactive user input superimposed onthe received image data; and transmitting the second augmented realityview for display on the client device in real time.
 19. The system ofclaim 18, wherein the information corresponding to the interactive userinput in the second augmented reality view includes one of a tutorialrelated to the at least one of the one or more identified objects or alisting of the at least one of the one or more identified objects forsale on a merchant website.
 20. The system of claim 15, wherein theinformation correlated with the identified object that is superimposedon the received image data in the augmented reality view is a video.